Psychological strategies for winning a geopolitical forecasting tournament.

نویسندگان

  • Barbara Mellers
  • Lyle Ungar
  • Jonathan Baron
  • Jaime Ramos
  • Burcu Gurcay
  • Katrina Fincher
  • Sydney E Scott
  • Don Moore
  • Pavel Atanasov
  • Samuel A Swift
  • Terry Murray
  • Eric Stone
  • Philip E Tetlock
چکیده

Five university-based research groups competed to recruit forecasters, elicit their predictions, and aggregate those predictions to assign the most accurate probabilities to events in a 2-year geopolitical forecasting tournament. Our group tested and found support for three psychological drivers of accuracy: training, teaming, and tracking. Probability training corrected cognitive biases, encouraged forecasters to use reference classes, and provided forecasters with heuristics, such as averaging when multiple estimates were available. Teaming allowed forecasters to share information and discuss the rationales behind their beliefs. Tracking placed the highest performers (top 2% from Year 1) in elite teams that worked together. Results showed that probability training, team collaboration, and tracking improved both calibration and resolution. Forecasting is often viewed as a statistical problem, but forecasts can be improved with behavioral interventions. Training, teaming, and tracking are psychological interventions that dramatically increased the accuracy of forecasts. Statistical algorithms (reported elsewhere) improved the accuracy of the aggregation. Putting both statistics and psychology to work produced the best forecasts 2 years in a row.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Identifying and cultivating superforecasters as a method of improving probabilistic predictions.

Across a wide range of tasks, research has shown that people make poor probabilistic predictions of future events. Recently, the U.S. Intelligence Community sponsored a series of forecasting tournaments designed to explore the best strategies for generating accurate subjective probability estimates of geopolitical events. In this article, we describe the winning strategy: culling off top perfor...

متن کامل

Modeling Strategies as Generous and Greedy in Prisoner's Dilemma like Games

strategies to become more successful. In compromise dilemma (C,D) and (D,C) have the best scores making a balance between diierent strategies possible. Like ESS this description of MAS, as a competition between generous and greedy strategies, tries to nd robust strategies that are able to resist invasion by other strategies. It is not possible to nd a single best strategy that wins, but it is p...

متن کامل

Item Response Models of Probability Judgments: Application to a Geopolitical Forecasting Tournament

In this article, we develop and study methods for evaluating forecasters and forecasting questions in dynamic environments. These methods, based on item response models, are useful in situations where items vary in difficulty, and we wish to evaluate forecasters based on the difficulty of the items that they forecasted correctly. In addition, the methods are useful in situations where we need t...

متن کامل

Confidence Calibration in a Multiyear Geopolitical Forecasting Competition

T research examines the development of confidence and accuracy over time in the context of forecasting. Although overconfidence has been studied in many contexts, little research examines its progression over long periods of time or in consequential policy domains. This study employs a unique data set from a geopolitical forecasting tournament spanning three years in which thousands of forecast...

متن کامل

The psychology of intelligence analysis: drivers of prediction accuracy in world politics.

This article extends psychological methods and concepts into a domain that is as profoundly consequential as it is poorly understood: intelligence analysis. We report findings from a geopolitical forecasting tournament that assessed the accuracy of more than 150,000 forecasts of 743 participants on 199 events occurring over 2 years. Participants were above average in intelligence and political ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Psychological science

دوره 25 5  شماره 

صفحات  -

تاریخ انتشار 2014